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« The MAILING DATE of this communication appears on the cover sheet with the correspondence address- 
All claims being allowable, PROSECUTION ON THE MERITS IS (OR REMAINS) CLOSED in this application. If not included 
herewith (or previously mailed), a Notice of Allowance (PTOL-85) or other appropriate communication will be mailed in due course. THIS 
NOTICE OF ALLOWABILITY IS NOT A GRANT OF PATENT RIGHTS. This application is subject to withdrawal from issue at the initiative 
of the Office or upon petition by the applicant. See 37 CFR 1.313 and MPEP 1308. 

1 . K This communication is responsive to 04/20/2005 and 06/07/2005 . 

2. S The allowed claim(s) is/are 1.2,5,6.9.10.13 and 14 . 

3. K The drawings filed on 19 September 2000 are accepted by the Examiner. 

4. ^ Acknowledgment is made of a claim for foreign priority under 35 U.S.C. § 1 19{a)-(d) or (0. 

a) S All b) □ Some* c) □ None of the: 

1. 13 Certified copies of the priority documents have been received. 

2. □ Certified copies of the priority documents have been received in Application No. . 

3. □ Copies of the certified copies of the priority documents have been received in this national stage application from the 

Intemational Bureau (PCT Rule 17.2(a)). 
* Certified copies not received: . 

Applicant has THREE MONTHS FROM THE "MAILING DATE" of this communication to file a reply complying with the requirements 
noted below. Failure to timely comply will result in ABANDONMENT of this application. 
THIS THREE-MONTH PERIOD IS NOT EXTENDABLE. 

5. □ A SUBSTITUTE OATH OR DECLARATION must be submitted. Note the attached EXAMINER'S AMENDMENT or NOTICE OF 

INFORMAL PATENT APPLICATION {PTO-152) which gives reason(s) why the oath or declaration is deficient. 

6. □ CORRECTED DRAWINGS ( as "replacement sheets") must be submitted. 

(a) □ including changes required by the Notice of Draftsperson's Patent Drawing Review ( PTO-948) attached 

1 ) □ hereto or 2) □ to Paper No./Mail Date . 

(b) □ including changes required by the attached Examiner's Amendment / Comment or in the Office action of 

Paper No./Mail Date . 

Identifying indicia such as the application number (see 37 CFR 1.84(c)) should be written on the drawings In the front (not the back) of 
each sheet. Replacement sheet(s) should be labeled as such in the header according to 37 CFR 1.121(d). 

7. □ DEPOSIT OF and/or INFORMATION about the deposit of BIOLOGICAL MATERIAL must be submitted. Note the 

attached Examiner's comment regarding REQUIREMENT FOR THE DEPOSIT OF BIOLOGICAL MATERIAL. 



Attach men t(s) 

1 . □ Notice of References Cited (PTO-892) 5. □ Notice of Informal Patent Application (PTO-152) 

2. □ Notice of Draftperson's Patent Drawing Review (PTO-948) 6. □ Interview Summary (PTO-413), 

Paper No./Mail Date . 

3. □ Information Disclosure Statements (PTO-1449 or PTO/SB/08), 7. ^ Examiner's Amendment/Comment 

Paper No./Mail Date 

4. □ Examiner's Comment Regarding Requirement for Deposit 8. S Examiner's Statement of Reasons for Allowance 

of Biological Material 9. □ Other . 
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DETAILED ACTION 

Continued Examination Under 37 CFR LI 14 

1 . A request for continued examination imder 37 CFR 1.114, including the fee set forth in 
37 CFR 1.17(e), was filed in this application after final rejection. Since this application is 
eligible for continued examination under 37 CFR 1.114, and the fee set forth in 37 CFR 1.17(e) 
has been timely paid, the finality of the previous Office action has been withdrawn pursuant to 
37 CFR 1.114. 

Response to Amendment 

2. This communication is responsive to the applicant's amendment dated 04/20/2005 and 
RCE examination request filed on 06/07/2005. The Applicant(s) amended independent claims 1, 
5, 9 and 13 (also see examiner's amendment below). 

Examiner^s Amendment 

3. An examiner's amendment to the record appears below. Should the changes and/or 
additions be unacceptable to applicant, an amendment may be filed as provided by 37 CFR 
1.312. To ensure consideration of such an amendment, it MUST be submitted no later than the 
payment of the issue fee. 

Authorization for this Examiner's Amendment is given by the applicant's representative, 
Thomas F. Presson, through a telephone call on 8/18/2005. The Examiner's Amendment is as 
following: 
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In the claims (refer to the amendment filed on 04/20/2005): 

Claim 1, see page 3, first line of the claim, after "An information processing device", 
insert -for processing sound data and picture data to generate a composed picture,--. 

Claim 5, see page 4, first line of the claim, after "An information processing device", 
insert -for processing sound data and picture data to generate a composed picture,-. 

Claim 13, see page 7, replace the first two Hnes (preamble) of the claim with -A 
computer readable medium, storing a program that makes an information processing device 
execute the program to generate a composed picture, comprising:-. 

End of Examiner's Amendment 

Allowable Subject Matter 
4. Claims 1-2, 5-6, 9-10 and 13-14 are allowed. 

The following is an examiner's statement of reasons for allowance: 
Regarding independent claims 1, 5, 9 and 13, the instant application is directed to an 
apparatus (device), method and computer readable medium for processing sound data and picture 
data to generate a composed picture. Each independent claim, combining other well-known 
features, identifies the uniquely distinct features of switching and selecting one among a plurality 
of registered pictures as a selected picture on the basis of a level (intensity — interpreted as 
magnitude or power ) of a first fi-equency band of the analyzed sound signal, when a first judging 
means judges that said level of said first firequencv band is above a first predetermined threshold 
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value: displaying a composed picture by composing the frequency-analyzed pictxire and said 
selected picture, when a second judging means judges that said level of a second frequency band 
is below a second predetermined threshold value; changing a composing method of said 
frequency analyzed picture and said selected picture on the basis of said level of said second 
frequency band of the analyzed sound signal, when said second judging means judges that said 
level of said second frequency band is above said second predetermined threshold value. 

5. The prior art of record, White (US 5,734,794), Ohsawa (US 4,973,897) and Gibson (US 
6,490,359 Bl), provided niunerous teachings of altemative techniques and approaches for 
extracting cues from audio speech to select from among a database of stored image cells to 
produce synthesized animated characters, analyzing spectrum by detecting signal levels of 
divided frequency bands, and transforming audio signal into a predefined visual image (three 
dimensional object) and dynamically changing and adjusting the related parameters of the audio 
effect images. However, the combined features as stated above, are not anticipated by, nor made 
obvious over the prior art of the record. 

6. Any comments considered necessary by applicant must be submitted no later than the 
payment of the issue fee and, to avoid processing delays, should preferably accompany the issue 
fee. Such submissions should be clearly labeled "Comments on Statement of Reasons for 
Allowance." 
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Conclusion 

7. Please address mail to be delivered by the United States Postal Service (USPS) as 
follows: 

Mail Stop 

Commissioner for Patents 

P.O. Box 1450 

Alexandria, VA 22313-1450 
or faxed to: 571-273-8300, (for formal communications intended for entry) 
Or: 571-273-8300, (for informal or draft communications, and please label 
"PROPOSED" or "DRAFT") 

If no Mail Stop is indicated below, the line beginning Mail Stop should be omitted from 
the address. 

Effective January 14, 2005, except correspondence for Maintenance Fee payments, 
Deposit Account Replenishments (see 1.25(c)(4)), and Licensing and Review (see 37 CFR 5.1(c) 
and 5, 2(c)), please address correspondence to be delivered by other delivery services (Federal 
Express (Fed Ex), UPS, DHL, Laser, Action, Purolater, etc.) as follows: 

U.S. Patent and Trademark Office 

Customer Window, Mail Stop 

Randolph Building 

Alexandria , VA 22314 
Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Qi Han whose telephone numbers is (571) 272-7604. The 
examiner can normally be reached on Monday through Thursday from 9:00 a.m. to 7:00 p.m. If 
attempts to reach the examiner by telephone are unsuccessful, the examiner's supervisor, 
Richemond Dorvil, can be reached on (571) 272-7602. 

Information regarding the status of an application may be obtained from the Patent 
Application Information Retrieval (PAIR) system. Inquiries regarding the status of submissions 
relating to an application or questions on the Private PAIR system should be directed to the 
Electronic Business Center (EBC) at 866-217-9197 (toll-free) or 703-305-3028 between the 
hours of 6 a,m. and midnight Monday through Friday EST, or by e-mail at: ebc@uspto.gov. For 
general information about the PAIR system, see http://pair-direct.uspto.gov. 



QH/qh 

August 18, 2005 



